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Abstract — The mutual information of a discrete time memo- 
ryless Rayleigh fading channel is considered, where neither the 
transmitter nor the receiver has the knowledge of the channel 
state information except the fading statistics. We present the 
mutual information of this channel in closed form when the input 
distribution is complex Gaussian, and derive a lower bound in 
terms of the capacity of the corresponding non fading channel 
and the capacity when the perfect channel state information is 
known at the receiver. 

Index Terms — Channel capacity, mutual information, Rayleigh 
fading, Gaussian distribution. 



selective Rayleigh fading channel has been further investigated 
by Yingbin and Venugopal [10] and derived upper and lower 
bounds on the capacity at high SNR. 

In this paper, we determine how the Gaussian input distribu- 
tion can contribute in non coherent Rayleigh fading channel. 
We achieve this by expressing the mutual information in 
closed form using Gauss-Hermit Quadrature 1 with a simple 
lower bound on it and subsequently identifying the maximum 
deviation of the actual capacity achieved with a discrete input 
in the presence of Gaussian input. 



I. INTRODUCTION 

An independent and identically distributed (iid) Gaussian 
is the capacity achieving input distribution for additive white 
Gaussian noise (non-fading) channel, a Rayleigh fading chan- 
nel when the Channel State Information (CSI) is perfectly 
known at the receiver, and when the CSI is known to both 
the transmitter and the receiver. However, when CSI is not 
known by neither the transmitter nor the receiver, the capacity 
achieving distribution is not Gaussian [1]. Therefore, it is of 
practical interest to find the achievable information rate of non 
coherent Rayleigh fading channels when the input distribution 
is complex Gaussian. 

Fading channels have been studied in depth and a plethora of 
literature is available on the upper and lower achievable rates 
over the wireless media; refer [2], [3] for a summary. However, 
most of the results were presented under various channel 
models applying constraints for mathematical representations, 
and the availability of (CSI) at the transmitter and receiver. 

The capacity of fading channels when the CSI is perfectly 
known at the receiver was investigated initially by Ericson 
[4], later by Lee [5], and Ozarow, Shamai and Wyner [6]. 
This capacity is calculated in an average sense due to the 
time varying nature of the signal to noise ratio (SNR). The 
fading channel with CSI at the receiver alone and at both the 
transmitter and the receiver was extensively studied in [7], [8]. 

The iid Rayleigh fading channel with no CSI was studied by 
Faycal [1], [9], where it was shown that the capacity achieving 
input distribution is discrete with finite number of mass points 
with new emerging points as SNR increases. These mass point 
distribution tends to be uniform as SNR approaches infinity, 
deviating much form that of a Gaussian. The non coherent time 
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II. SYSTEM MODEL 
Consider the Rayleigh fading channel, 

y = ax + n 



(1) 



where y is the complex channel output, x is the complex 
channel input, a and n represent the fading and noise com- 
ponents associated with the channel. It is assumed that a 
and n are independent zero mean circular complex Gaussian 
random variables. Also assume that cr^/2 and ct^/2 are the 
equal variance of real and imaginary parts of the complex 
variables a and n respectively and the time index in Q is 
omitted for simplicity. The random variables a, x, and n 
are considered to be independent of each other. The input 
x e X is average power limited: _E[|a;| 2 ] = il 2 , < P. The 
constant 7 = — L e~ y \ogydy ss 0.5772..., denotes the 
Euler's constant. All the differential entropies and the mutual 
information are defined to the base "e", and the results are 
expressed in "nats". It is assumed that neither the receiver nor 
the transmitter has the knowledge of channel state information 
other than the statistics. 

III. THE MUTUAL INFORMATION 

The Mutual information between the input and output of a 
Rayleigh fading channel can be expressed as [11] 



/■oo roo 

I(X:Y)= / / PY \x(y\x)px(x) 
Jo Jo 

py\x(v\x) 



x loe 



J™ PY\v{y\v)pv(v)dv 



dxdy (2) 



considering the probability distribution of the magnitudes of 
the input and output random variables X and Y. It should 

' One of the best methods that can be used to evaluate the integrals of the 
type J °° e~ x g(x)dx ~ £2=1 ^iS^i) m terms of proper weights u>i and 
the roots %j of Hermit Polynomials H m (x). 
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be noted here that since we only consider the distribution of 
magnitudes of the random variables, the integral in (0 is taken 
from to oo. The conditional probability density function 
(pdf) p Y \x{y\x) [9] [11] is given by 



PY\x(y\x) 



r exp 



(3) 



Assume the average mean squared power of both fading A, 
(a e A) and noise N, (n e N) are unity. This assumption 
is valid since the effective received power at the receiver is 
the combination of both a 2 and Q 2 and the SNR is the ratio 
between the average received power and the average noise 
power. Therefore, the same output exists for various a 2 and 
er 2 on the appropriate selection of Q 2 ,. With this assumption, 
can be written as 



py\x(v\x) 



2y 



rexp 



-y 



(4) 



Without loss of generality, the magnitude sign is removed in 
@ and the same notation will be used throughout the rest of 
this paper. 

The mutual information [12] in can be simplified to 



I(X:Y) = h(Y) - h(Y\X) 

) 

p Y (y)logp Y {y)dy 



(5a) 



o 

oo 



px(x)\og{l + x 2 )dx + log 2 - (1 + -L) 



(5b) 

where the first term in (I5b> is the channel output entropy 
h(Y). This was originally proven by Taricco [11] deriving an 
analytical expression for the channel capacity using Lagrange 
optimization method with an additional constraint. 



With the detailed proof provided in Appendix A, we can 
reduce Q to 



lo g 2+(l+I), (8) 



where the exponential integral Ei(ir) = —f^° e^/tdt. Note 
that the channel capacity when the CSI is perfectly known at 
the receiver is [2], [4], [5], 



= _ eaq) ( J_)Ei(— V (9) 

\ snr J \ snr J 

where snr = fl 2 , since a 2 = 1. Therefore, h(Y\X) in non 
coherent Rayleigh fading with Gaussian input can be expressed 

i 

(10) 



h(Y\X) = ic rcsi 



log2+(l + 1) 



B. Output Entropy 

The output pdf py(y) = f Px(x)PY\x(y\ x )dx for the 
Gaussian input can be written as 



Pv(y) 



2x -x l 



2y 



rexp 



1 + x 2 

Substituting il It in the first term of i5bl gives 

4xy / - 2 



1 



dx. 



(ID 



h(Y) 



oo poo 



x loe 



^0 

oo 



n 2 x {i + x 2 ) 

Axy 



exp 



x 



o n 2 x (l + x 2 ) 



x 



l + x 2 

,2 



1 



dx 



dx 

dy. 
(12) 

To the best of our knowledge, this integral can not be 
evaluated analytically V il 2 . In the following section we show 
the use of Gauss-Hermit polynomials to drive a closed form 
expression. 



IV. GAUSSIAN INPUT IN NON COHERENT 
RAYLEIGH FADING 

Recall the channel model ([0, and assume the input distri- 
bution is Gaussian. Then the distribution of both the real and 
imaginary parts of x are independent and Gaussian. Therefore, 
the distribution of the |x| is Rayleigh with the pdf [13] 



Px(x) 



2x 



x > 0. 



(6) 



It is assumed that both the real and imaginary parts of input 
have equal variance f2|/2. The magnitude sign is omitted in 
l|6} as mentioned in the previous section. 

A. Output Conditional Entropy 

Having described the input distribution px{x) for non 
coherent Gaussian input channel, we now focus on the output 
conditional entropy h{Y\X) in J5bl >. By substituting (|5Jl in 
\5b\ (except the first term described as h(Y)), we have 



h{Y\X) 



log 2 



<> 2 



log(l + x 2 ) 



dx 



(7) 



C. Gaussian Quadrature and Hermit Polynomials 

A common method for approximating a definite integral 
is f Lo(x)f(x)dx ~ J2i=i Aif(xi), which is called Gauss- 
quadrature assuming the moments are defined and finite or 
bounded of the function oj(x) [14]. The Gaussian quadrature 
formula has a degree of precision or exactness m if the 
solution is exact whenever f(x) is a polynomial of degree 
< m or equivalently, whenever f(x) = {1, x, x m } and 
it is not exact for f(x) — x m+ . The xi are called the 
nodes of the formula and Ai are called coefficients (or 
weights). If bj(x) is non negative in [a, b], then n points 
and coefficients can be found to make the solution exact for 
all polynomials of degree < 2q — 1 and it is the highest 
degree of precision which can be obtained using q points [14]. 

If the ui(x) is in the form of e~ x the solution to the 
integral can be found using the roots (nodes) of the Hermit 
polynomial H q (x) [15] and the weights are given by 

Wi q^H^ixi)] 2 ' 

The roots and the weights are excessively given in [15] for 
a = and b = oo with q = 15. 
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D. Output entropy h(Y) in Closed form 

Define t 2 = x 2 /il x , where dx — £l x dt, then substitution 
into dl It gives 



Pv(y) 



2ty 



t=o 



(1 + O.x 2 ) 



exp 



-y 



2(i + n x x 2 



dt. 

(13) 



This integral is in the form of J a 4>(v)ui{v)dv where uo(v) = 
e~* . Therefore it can be evaluated using Hermit polynomials 
in the form of py{y) — SjLi w jfi v j)- Th e quantities Vj and 
u>j are the roots and the weights of the Hermit polynomials 
respectively. Applying these weights and roots in (1131 we get 



Pr(y) =X^'7i 



2vjy 



2(1 + n x v 2 ) 



(14) 



Using this result, the output entropy h(Y) can be written as 



h(Y) = 




exp 



-y 



2vjy 



j'=i 



(l + flxW?) 



2(1 + n x v 2 
-y 2 



2(i + n x v 2 ) 



>dy. 



(15) 



Taking the integration inside and substituting t 2 = y 2 /[2(l + 
il x v 2 )} in H5i , the £ th term where £ = 1, ....,q can be written 

as 

— * 2\/2ujjVjt 



f°° I 9 2 

fc(y)* = - ^ e~* (4^i) log | £ - 

x ^(1 + fl x vj) exp 




(i + 



di. (16) 



The integral in this I th term has the form of f cf>(v)uj(v)dv 
where ui(v) = e~* . We can now simplify (I16> using Hermit 
polynomials as 

h(Y) e = f; Wi (4 Wi ) log I £ 



x v/(l + fiafuf) exp 



^ (i + n x v 2 ) 



a (1 + n g «f ) 

(1 + tt^ 2 ) 



(17) 



The output entropy ft-(F) = — 5Z|=i ^OO* can b e shown as 
h(Y) = -± log J £ ^tyt* 



x ^(1 + fl^) exp 



j= - (i + n x v 2 ) 
2 (i + n x vf 



(1 + V x v 2 ) 



(18) 



The /i(F) presented in the closed form in Jl 8i using Gauss- 
Hermit quadrature is very useful in finding the mutual infor- 
mation for any SNR and the computational time is much less 
than the numerical integrations to be carried out with high 
accuracy. The mutual information can be found subtracting 




Fig. 1. The mutual information with Gaussian input is below the channel 
capacity achieved by a discrete input. (1) The mutual information with 
gaussian input. (2) The channel capacity with a discrete input. (3) The channel 
capacity, C rcs i with CSI. (4) The non fading channel capacity, C cn f. 



l llOt from i ll 8t . Fig. 1 depicts the mutual information obtained 
using the Gauss-Hermit polynomial method with the channel 
capacity [1]. 

Since the closed form expression obtained in the previous 
section is intricate with no straightforward or easy method to 
attain the result, we will show how to derive an analytical 
lower bound for <|3J when the input is Gaussian distributed to 
understand its performance in a simplistic manner. 

E. Lower Bound on Mutual Information 
We have the following result. 

Proposition 4.5.1: The mutual information of an iid non 
coherent Rayleigh fading channel when the input distribution 
is complex Gaussian, is lower bounded by 



I(X;Y) > i(C cnf -C rcsi ) 



(19) 



where C cn f and C lcs ; are the capacity of the non fading 
complex Gaussian channel and the capacity of the Rayleigh 
fading channel when the CSI is perfectly known at the 
receiver. The equality holds when the average input power is 
zero. 

Proof: We consider I(X; Y), h(Y), and h(Y\X) when the 
input power f2 2 is zero. Using l|8}, we get h(Y\X)^2 =a = 
—log 2 + (1 + 2). Since the mutual information is zero with 
no channel input, we can write 

h(Y) ai=0 = h(Y\X) nl = Q . (20) 

The quantity h(Y) in ill 2b is monotonically increasing with 
SNR, thus it has the minimum 



h(Y) B 



-log2 + (l + 7 



(21) 



Consider, a non fading channel whose capacity achieving dis- 
tribution is Gaussian, where h(Y\X) n f = h(N) — ilog(7re<7 2 ) 
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Fig. 2. Entropy Comparison with Fading and Non fading Models: (1) Output 
conditional entropy of non fading channel, h n f(Y\X). (2) Output conditional 
entropy of fading channel with Gaussian input. (3) Output entropy of fading 
channel, h(Y). (4) Output entropy of non fading channel, h(Y) n {. The h(Y) n f 
and h(Y) treated in this paper have a similar shape and the difference is 
decreasing with SNR. 



is constant over input power. The monotonic increase of 
h(Y) n { = ilog[7re(cr^ + with SNR results in significant 
increase in channel capacity. 

The fading introduces the monotonic increase of output con- 
ditional entropy with SNR. In our investigation, we compare 
the differential output entropies in both cases and use the 
properties of the mutual information such as monotonic and 
non decreasing in order to draw a lower bound. We consider 
a single dimension of the non fading channel where the input 
and noise are complex random variables and hence both the 
output and the conditional entropies are taken accordingly. 
Fig. 2 portrays h(Y) and h(Y\X) of the two channel models, 
where 

h(Y) nf = ^log-Mi + Ql)} (22) 



and 



1 



h(Y\X) nf = -log(Tre) 



(23) 



Note that the abbreviation "nf" refers the Gaussian channel 
with no fading present. Since the Gaussian distributions are 
the entropy maximisers for a power limited input, 



h(Y) nf > h(Y) v n*. 
Lets define the difference in i24i 

G = h(Y) ni -h(Y), 

and investigate the bounds when = and 
Gq2 _ can be written as 

Gnl=Q = h(Y)nf,n 2 x =o - h(Y)mm 

= ilog(7re)+log2-(l + 2). 



(24) 

(25) 
oo. The 

(26) 



To calculate the difference when f2^ 
upper bound 

I i m 

I{X-Y)< 1 



oo, we will use the 



(27) 



lim 

Q% -> oo 

given in [16]. Using d 1 01 and dl2t . we can write the mutual 
information of the channel as 



I(X; Y) = h(Y) - ic rcsl + log 2 - (1 + 1) 



(28) 



Substituting I27i and (1281 in d25i . we get, 



1 lim r r „o„ 

{iogMi + o|)] 



2 fi| -> oo 
1 

M 

L 



+ exp 



Ei 



-1 



7 + log2-(l + ^) 



7 + log2-(l + ^), 



(29) 



where L = ^[7 + log(7re)]. Refer the Appendix B for the 
detailed proof. Therefore we can write j29t as, 

Gsi^oo > log(2V^) - (1 + 7)- (30) 

Note that Gn 2 =o > G^^^. The differential entropies 
defined in here are monotonic and concave with il 2 . The 
gap defined in J25I is the difference between two monotonic 
concave functions which would not necessarily be monotonic 
and concave. However, since Gq2 =0 is higher than G^^^, 
the quantity G for any should be less than Gq2 _ due to 
the properties of the two entropies mentioned. Therefore we 
conclude that the maximum difference occurs at fl 2 = 0. This 
G m ax = Gq2 =0 can be used to lower bound h(Y) in H2i and 
we get 



h(Y) > h{Y) af - G„ 



(31) 



Therefore, the mutual information in J28t > can be lower 
bounded as 



I(X;Y) > h(Y) al - 

- h(Y) nf 
1, 



2 rcsl 
1 



i og 2 + (i + I; 



log(Tre) - -C, 



(32) 



2 -log(l+0^) 2 
using JTOb . ( l22l . and (|26j. With C cnf = log (1 + we prove 

Gl- 
it should be noted here that dl9l asymptotically converges to 



7/2 since 



lim 



(C cnf -C7 rcsi ) =7 [16]. 



V. NUMERICAL RESULTS 



We compare the new lower bound with the mutual informa- 
tion found with the closed form expression attained through 
Gauss-Hermit quadrature in the previous section. 

The lower bound in dl9l is plotted against the input power 
in Fig. 3 with the mutual information obtained using the 
closed form expression. Further, it is compared with channel 
capacity acquired with discrete input [1]. The channel capacity 
is plotted for comparison only with two discrete mass points 
one located at the origin since the probability of other mass 
points are small at low SNR and even suited for a simple 
comparison at high SNR due to the percentage increase in 
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Fig. 3. Analysis of the lower bound in fading channel: (1) The lower bound 
with Gaussian input. (2) The mutual information acquired using the closed 
form expression with Gauss-Hermit quadrature. (3) The channel capacity 
achieved with a discrete input. 



The CSI is obtained by training with known pilot symbols 
inserted in the transmitted sequence. Due to the presence 
of noise or under the fast fading conditions, the receiver 
is provided with imperfect CSI and the performance of the 
channel depends on its quality. Considering the worst case 
scenario, the channel can become non coherent with Gaussian 
input which optimises the mutual information with perfect 
CSI. Therefore, the closed form expression shown in this paper 
could be used as the lower bound with the imperfect CSI at 
the receiver. 



VII. APPENDIX 

A. PROOF OF CONDITIONAL ENTROPY IN © 
We write Q as 



ft(y|x) = ^i-iog2 + (i 



7> 



(33) 



where 



10 20 30 40 50 60 70 

Input Power 



90 100 



Fig. 4. Percentage lost using the lower bound: (1) With the mutual 
information found numerically for Gaussian input. (2) With the channel 
capacity. 



capacity is low [9]. The percentage lost in mutual information 
with a Gaussian input on our lower bound is plotted in Fig. 4 
where it shows 30% less than the numerical values. 

VI. CONCLUSIONS 

The mutual information of a non-coherent Rayleigh fad- 
ing channel when the input is Gaussian distributed can be 
expressed in closed form using Gauss-Hermit quadrature. 
Further it can be lower bounded as the difference between 
the capacities of non fading channel and the Rayleigh fading 
channel when the perfect channel state information is known at 
the receiver. Even the Gaussian input is not optimal, our result 
shows the minimum achievable information rate which can 
be used as the worse case scenario in non coherent Rayleigh 
fading channels. The lower bound found is never lower than 
70% of the actual. 



lim f kl x ( —x 2 
Ex = / — exp — — 

fci^ooJo fc 2 V fc 2 



log(l + x 2 )dx, x>0 



(34) 
and fc 2 = 

Consider the integral part of J34> . Using integration by parts, 
we get 



k 

K 2 



_— exp ( — — Uogfl + x z )dx 

K2 \ k 2 1 



1 exp (— ^- ] IoiaCI -.<-) 



— X 

„ exp ^;(i+^ 2 ) 



dx. (35) 



Substituting t = 1 + x 2 , the second term of J35I can be written 



as 



fci 



exp 



2 \ xdx _ 1 / 1 \ [ 1+k ^ ex p(fe|) 



k 2 J {1 + x 2 ) 2 l ' NP V 



2/ Jl 



-dt. 



(36) 



Substituting u = t/k 2 in the right hand side of d36t we get 
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Using this identity in fl35i we get 



x 

i-exp , 

«2 V k 2 



log(l + x 2 )dx 



mi 



i 



Ei - 



1 + x 2 



2 6XP V fc 2 



log(l + a; 2 ) 



Now we can write (I34> as 

El = - exp — Ei 

fci^oo 2 [ \k 2 J \ k 2 



By applying La'Hospital's Rule, it can be shown that 

lim 1 / — fci 2 \ , ,9, 

Moga + fc! 2 ) = o. 



(38) 











-5 exp 


:*)■( 


. fa) 


• [7] 



(39) 



(40) 



(41) 



z o exp 

Also note that Ei(-oo) = [17], thus 

By substituting ( 14-li in (I33> completes the proof. 



B. PROOF OF THE ASYMPTOTIC ANALYSIS USED IN <29l 

Let's define £ = SI 2 and we write the asymptotic value in 
(J29) as, 

i = ^ lm oo log[7re(l + 0]+expQWy) (42) 

where the exponential integral can be expressed as, [18] 

Ei(-x) = 7 + e~ x loga: + f e~'\ogtdt. (43) 

./o 

Using this identity we get, 
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which competes the proof. 
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